nVIDIA A30 with 24GB, 180W
NVIDIA A30 Tensor Core GPU
Memory type GDDR6
Memory size 24 GB
GPU memory bandwidth 933GB/s
Media engines 1 optical flow accelerator (OFA)
1 JPEG decoder (NVJPEG)
4 video decoders (NVDEC)
1 JPEG decoder (NVJPEG)
4 video decoders (NVDEC)
A30 leverages groundbreaking features to optimize inference workloads. It accelerates a full range of precisions, from FP64 to TF32 and INT4. Supporting up to four MIGs per GPU, A30 lets multiple networks operate simultaneously in secure hardware partitions with guaranteed quality of service (QoS). And structural sparsity support delivers up to 2X more performance on top of A30’s other inference performance gains.
